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I.  INTRODUCTION 


Development  of  the  Problem 


Food  service  operations  are  typically  managed 
under  the  guise  of  management  by  exception.  Managers 
respond  to  some  stimulus  which  threatens  homeostasis.  These 
crises  are  compounded  by  the  frequency  of  their  occurrence. 
Typical  examples  include  compl aints  about  the  food,  dis¬ 
gruntled  employees,  unavailability  of  essential  menu  items, 
pilferage,  overspent  budgets  and  equipment  failures. 

The  existing  management  information  system  con¬ 
sists  of  by-products  from  cost  accounting,  timekeeping,  and 
whatever  surveying  is  performed  to  satisfy  requirements  of 
the  Joint  Commission  on  Accreditation  of  Hospitals.  These 
by-products  are  not  adequate  in  supplying  the  cybernetic 
needs  of  the  operation.  For  example,  the  key  by-product  of 
the  cost  accounting  system  is  rations  served.  Data  are 
maintained  on  a  daily  basis,  daily  cumulative  basis,  monthly 
basis,  quarterly  basis  and  fiscal  year  basis.  While  its 
importance  as  a  driving  force  for  resources  should  not  be 
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diminished,  this  quantitative  measure  of  performance  is  of 
little  value  in  directing  the  manager  to  potential  crises. 

Food  service  crises  represent  misapplications  of 
resources,  poor  quality,  and  general  mismanagement, 
especially  if  they  could  have  been  avoided.  The  impetus 
that  has  resulted  in  the  focuses  on  quality  assurance,  risk 
management,  cost  containment,  and  appropriate  use  of  scarce 
health  care  resources  mandates  that  food  service  operations 
be  managed  efficiently  and  effectively.  The  real  crisis 
facing  food  service  operations  is  the  lack  of  information 
needed  to  provide  management  direction. 

The  problem  of  information  certainly  is  not  r.ew, 
nor  unique  to  the  food  service  operations.  As  the  president 
of  a  banking  corporation  observed, 

I  think  the  problem  with  management  information 
systems  in  the  past  in  many  companies  has  been 
that  they're  overwhelming  as  far  as  the  executive 
is  concerned.  He  has  to  go  through  reams  of 
reports  and  try  to  determine  for  himself  what  are 
the  most  critical  pieces  of  information  contained 
in  the  reports  so  that  he  can  take  the  necessary 
ac  n  t ■ H  correct  any  problems  that  have  aris- 
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Rockart  reported  the  development  of  a  new  systems 

approach  of  defining  managerial  information  based  on 

2 

critical  success  factors. 

...  A  company's  information  system  must  be 
discriminating  and  selective.  It  should  focus  on 
success  factors.  In  most  industries  there  are 
usually  three  to  six  factors  that  determine 
success;  these  key  jobs  must  be  done  exceedingly 
well  for  a  company  to  be  successful.’' 

Three  examples  of  the  use  of  critical  success 

4 

factors  were  described.  Styling,  an  efficient  dealer 
organization,  and  effective  control  of  production  costs 
have  been  identified  as  the  industrial  critical  success 
factors  for  the  automotive  industry.  In  the  food  proces¬ 
sing  industry,  initial  success  factors  include  the  develop¬ 
ment  of  new  products,  the  distribution  of  products,  and 
effective  advertisement.  Success  in  the  life  insurance 
industry  depends  on  the  development  of  agency  management 
personnel,  effective  control  of  clerical  personnel,  and 
innovation  in  creating  new  types  of  policies. 

Critical  success  factors  thus  are,  for  any 
business,  the  limited  number  of  '.reas  in  which 
results,  if  they  are  sati sfactory ,  will  ensure 
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successful  competitive  performance  for  the 

organization .  They  arc  the  few  key  areas  where 

things  must  go  right  for  the  business  to 
5 

flourish. 


While  the  food  service  operations  of  the  Army 
Medical  Treatment  Facilities  are  not  concerned  about  the 
performance  of  a  competitive  nature,  they  are,  nonetheless, 
concerned  about  satisfactory  and  successful  performance. 

The  premise  of  this  author  was  that  a  management 
information  system  for  a  food  service  operation  could  be 
designed  using  critical  success  factors.  Such  a  system  could 
provide  the  food  service  manager  with  a  tool  to  better  manage 
the  operation. 


Research  Question 

Is  the  critical  success  factor  concept  viably 
applicable  for  use  in  developing  a  management  information 
system  for  use  in  U.S.  Army  hospital  Nutrition  Care 
Divisions? 

Def i ni ti ons 

There  are  five  definitions  which  are  germane  to 
the  following  discussion: 


1.  Critical  success  factors:  Those  areas  in  which 
results  must  be  at  least  satisfactory  for  the  activity  to  be 
successful.  Criteria  are  developed  for  each  factor  on  which 
to  measure  performance. 

2.  Delphi  technique:  A  method  where  the  iterative 
use  of  questionnaires  results  in  group  consensus.  It  will 
also  be  referred  to  as  a  Delphi  process. 

3.  Management  information  system:  For  purposes  of 
this  research,  a  management  information  system  is  a  formal 
method  of  supplying  the  cybernetic  needs  of  a  manager  sc  tha 
better  control  of  the  operation  is  obtained. 

4.  Partici pant  panel :  A  selected  group  of  dieti¬ 
tians  who  will  participate  in  a  Delphi  process.  It  will  also 
be  referred  to  as  the  panel. 

5*  Prime  measures:  Those  key  measures  which 

indicate  the  status  of  critical  success  factors.  For  exam¬ 
ple,  one  prime  measure  for  employee  morale  might  be  turnover. 

Objectives 

There  are  six  major  objectives  which  will  be  accom¬ 
plished  during  the  research  process. 


1.  A  literature  review  will  be  conducted. 


2.  A  participant  panel  of  Army  dietitians  will  be 
selected  to  participate  in  a  Delphi  process. 

3.  Using  the  Delphi  technique,  critical  success 
factors  will  be  identified. 

4.  Prime  measures  for  each  critical  success 
factor  will  be  determined  from  comments  generated  through 
the  Delphi  process  and  the  literature  review. 

5.  Methods  will  be  developed  to  collect  data  on 
the  prime  measures  for  each  critical  success  factor. 

6.  The  results  of  this  research  will  be  forwarded 
to  the  Chief  Dietitian,  Office  of  The  Surgeon  General,  with 
recommendations  for  implementation. 

Criteria 

1.  Twenty-five  dietitians  must  complete  their 
participation  in  the  Delphi  process. 

2.  Each  of  the  top  5  critical  success  factors 
must  have  been  ranked  in  the  top  five  by  at  least  sixty 
percent  of  the  Delphi  panel. 

3.  Prime  measures  must  be  identified  for  each 
critical  success  factor. 

4.  There  must  be  identifiable  means  of  collecting 
data  for  each  prime  measure. 


5.  The  prime  measures  must  identify  some  degree  to 
which  the  critical  success  factors  have  been  achieved.  The 
development  of  standards  on  which  to  base  success  is  beyond 
the  scope  of  this  research,  but  will  be  identified  on  the 
implementation  plan. 


Assumptions 

The  author  acknowledges  the  following  assumptions: 

1.  The  critical  success  factors  identified  through 
the  Delphi  process  accurately  reflect  the  true  indicators  of 
success  for  a  food  service  operation. 

2.  The  participant  panel  will  maintain  a  high 
level  of  motivation  throughout  the  Delphi  process. 

3.  The  participant  panel  members  possess  suffi¬ 
cient  skills  in  written  communication, 

Limi tations 

The  following  general  limitations  of  this  research 
are  known  at  this  time. 

1.  The  management  information  system  developed  by 
this  research  may  only  be  applicable  to  U.S.  Army  hospital 
Nutrition  Care  Divisions  located  within  the  continental 


United  States. 


2.  The  research  will  be  limited  to  the  process  of 
developing  a  management  information  system  using  critical 
success  factors.  The  validation  of  these  factors  is  ueyond 
the  scope  of  this  research. 

3.  The  Delphi  process  will  be  limited  to  four 
iterations.  At  the  end  of  the  fourth  iteration,  those 
factors  which  have  received  at  least  sixty  percent  consensus 
will  be  identified  as  the  critical  success  factors. 

Literature  Review 

An  extensive  literature  review  was  made  in  the 
several  subject  areas  which  have  congruence  with  this  topic, 
including  cybernetics,  planning  and  control.  Information  and 
information  systems,  quality  assurance,  and  computerization. 
The  literature  reviewed  ranged  from  the  broad  general  manage¬ 
ment  area  to  the  specific  area  of  hospital  food  service. 

Cybernetics 

As  a  system,  the  Nutrition  Care  Division  can  be 
described  a  "set  of  interrelated  and  Interdependent  parts 
designed  to  achieve  a  set  of  goals."®  Like  any  other 
system,  it  can  be  conceptualized  by  the  systems  model  as 
Illustrated  in  Figure  1.^ 
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ENVIRONMENT 

INPUT  - - >  TRANSFORM - >  OUTPUT 

t 

FEEDBACK  < - 

Fig.  1.  Systems  Model 

Examples  of  Inputs  Include  food  Ingredients, 
personnel,  knowledge  of  nutrition,  equipment,  and  supplies. 
The  transfer  Includes  food  preparation  and  service,  patient 
assessments,  menu  writing,  and  dietary  education.  Outputs 
include  patient  trays,  dining  hall  meals,  educated  patients 
(with  the  desired  ultimate  outcome  of  changed  dietary 
behavior),  and  satisfied  employees.  In  addition  to  the 
hospital  environment,  the  system  operates  within  the  local 
military  and  the  broader  Army  Medical  Department  environ¬ 
ments.  The  component  of  concern  to  this  study  Is  the 
feedback  or  cybernetic  loop. 

Janke  asserted  that  although  cybernetics  could  be 
generalized  as  the  feedback  component  of  a  system,  it  could 
be  more  accurately  described  as  a  system.  In  itself,  with 

g 

Inputs,  outputs,  transform^  feedback,  and  environment. 


r  ■itvwfTT ••vm- -Twr.-ram  ■  nmnmmxm 
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Information  systems  management  introduces  the 
perception  of  the  cybernetic  complement  to  energy 
systems  and  some  unique  context  specific  techniques 
for  the  identification  and  manipulation  of  systems 
variables  during  the  management  stages.  .  .  . 

Information  is  the  one  single  source  and  conduit 

of  management  power;  the  single  purpose  nf 

information  is  to  reduce  uncertainty  in  the 

decisions  made  In  managing  energy  systems.  In 

this  respect,  Information  Is  quite  different  from 

data.  Information,  as  opposed  to  energy,  is  not 

consumed  when  it  is  used.  Finally,  Information 

systems  (cybernetics)  as  opposed  to  data  system- 

(commodity)  management  is  based  upon  an  Initial 

determination  of  relevant  Information  needs  and 

g 

requirements  of  the  energy  system. 

Information  and  Information  Systems 
Toffler  and  Naisbltt  have  brought  considerable 
popular  attention  to  the  magnitude  of  the  information  explo¬ 
sion.10  Not  everyone  has  been  optimistic  about  this  prol i  • 
feratlon.  Daniel  warned,  in  1961,  about  an  Information 

crisis.  He  described  a  widening  gap  between  an  organi¬ 
zation's  information  needs  and  Its  ability  to  supply  that 

Information.11  His  study  of  this  problem  concluded  that 
while  data  were  generally  available  throughout  organization 
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structure,  it  did  not  naturally  flow  to  the  manager.  The 
distinction  between  data  and  information  has  been  well 
described.  4  Advances  in  information  and  computer  techno¬ 
logy  have  allowed  for  vast  manipulation  of  data,  but  has  not 
facilitated  an  improved  flow  of  real  information.  Research 
indicated  that  despite  the  use  of  complex  conceptual  models, 
information  pitfalls  continue  to  exist  primarily  due  to  a 

failure  to  determine,  properly  and  accurately,  the  Informa- 

1 3 

tion  needs  of  an  organization. 

Four  major  approaches  have  previously  been  used  to 

determine  and  supply  Information. 14  The  by-product  method 

1 5 

capitalizes  on  existing  data  manipulation  systems.  The 
general  focus  has  been  on  f Inancial/accountlng  systems, 
especially  those  automated  functions.  The  Information 
flowing  to  the  manager  consists  of  reams  of  computer  print¬ 
outs  and  summary  reports  which  are  produced  as  by-products  of 
the  functions  of  payroll,  accounts  payable,  and  Inventory 
computer  runs.  In  hospitals  where  semi -automated  nurse  call 
systems  have  been  Installed,  by-products  consist  of  patient 
listings,  which  may  contain  physician  diet  orders. 

The  null  approach  is  generally  characterized  by  the 
lack  of  any  information  system,^  Premised  on  the  idea  that 


needed  information  would  be  supplied  as  needed  through  word 


of  mouth  or  memorandum,  the  response  characterized  by  this 
system  can  be  best  described  as  crisis  management.  In 
Nutrition  Care  Divisions,  daily  diary  notations  are  an 
example  of  a  null  approach  to  information. 

The  key  indicator  system  is  the  fastest  growing 
management  information  system  of  the  eighties.*7  A  set  of 
key  indicators  of  business  health  are  selected.  Periodic 
written  reports  provide  the  status  of  these  indicators.  With 
the  use  of  desk  top  computer  terminals,  key  indicators  can  be 
constantly  updated  and  presented  visually  with  charts, 
graphs,  and  figures.  The  Medical  Department  Activity's 
Command  Performance  Summary  Report  is  an  example  of  a  manual 
key  indicator  system. 

The  total  study  method  Is  usually  known  by  other 
names,  including  systems  analysis,  systems  management,  and 

1  Q 

information  audits.  The  benefits  of  this  method  are  rarely 
disputed,  but  the  time  and  expense  Involved  generally  prohi¬ 
bit  its  use  for  routine  information  gathering. 

Pete rmi nation  of  Needs 

Mason  concurred  with  Janke  in  concluding  that 

management  Information  systems  should  facilitate  a  manager's 

1 9 

ability  t.o  make  decisions.  His  research  asserted  that  the 
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closer  an  information  system  is  keyed  to  the  manager's 

needs,  the  better  the  decisions  would  be.  Mason  proposed 

the  decision-oriented  approach  for  the  development  of 

20 

management  information  systems.  Decisions  are  the  result 
of  a  series  of  activities  which  Mason  summarized, 

1.  A  sou rce  consisting  of  the  physical  activities 
and  objects  which  are  relevant  to  the  business. 

2.  The  observation,  measurement  and  recording  of 
data  from  the  source. 

3 

The  drawing  of  inferences  and  predictions  from 
the  data. 

4.  The  evaluation  of  inferences  with  regard  to 
the  values  (objectives  or  goals)  of  the 
organization  and  the  chops  1 ng  of  a  course  of 
action. 

21 

5.  The  taking  of  a  course  of  action. 

These  steps  are  illustrated  in  Figure  2. 

PREDICTIONS  VALUES 

SOURCE  - >  DATA - >  and  — >  arid  — >  ACTION 

I Nh  tRENCES  CHOICE 


Fig  2.  Steps  In  Decision  Making 
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Mason's  research  revealed  four  basic  designs  for 
management  information  systems  which  are  conceptualized  in 
Appendix  A.  The  differences  in  the  designs  are  the  point 
where  the  i nf ormati on  system  interfaces  with  the  decision 
making  system. 

Mason  further  presented  a  feedback  or  cybernetic 

information  system  formed  as  combinations  of  the  four  basic 
22 

designs.  This  is  conceptually  illustrated  in  Figure  3. 


The  basic  cybernetic  model  commences  with  some 
norm  or  target  being  set  by  a  decision-making 
information  system.  Then  action  is  taken  pursuant 
to  this  goal.  Subsequently,  observations  are  made 
to  measure  the  effect  that  the  action  has  upon  the 
source,  and  the  resulting  "feedback"  Is  recorded 
in  a  databank.  These  databank  items  are  then 
compared  with  the  target  to  generate  a  variance, 
error,  or  mis-match  signal  which  shows  the  degree 
of  deviation.  The  mismatch  signal  is,  In  turn, 
processed  through  the  predicti ve-i nf erentl al  and 
decision  making  stages.  Finally  action  Is  taken 
with  the  intent  of  reducing  the  deviation  to  zero. 
This  cycle  is  repeated  to  maintain  the  system  "on 
course".23 


SOURCE:  Richard  0.  Mason,  "Basic  Concepts  for  Designing  Management 

Information  Systems,,"  cited  by  Alfred  Rappaport  Information  for 
Decision  Making.  Englewood  Cliffs,  NJ:  Prentice-Hall ,  Inc.,  1975. 
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Shear  studied  the  information  needs  of  hospitals 

and  the  several  management  information  systems  attempting 

24 

to  provide  for  those  needs.  He  concluded  that  one  of  the 

most  important  capabilities  of  a  management  information 

system  was  its  ability  to  evaluate  performance,  including  a 

measurement  of  factors  that  directly  contribute  to  the 

success  of  goal  (objective)  achievement.  Shear  recommended 

that  management  information  systems  be  developed  along 

system  (subsystem)  lines  instead  of  along  departmental 

2  5 

(organization)  lines.  His  conclusion  found  congruence 
with  Janke's  assertion  that  cybernetic  systems  were  comple¬ 
ments  of  energy  systems. 

Sadek  et  al  presented  a  correlation  between 

P  fi 

having  too  much  i n forma ti on  and  being  mi  si nf ormed .  To 

avoid  this  Dearden  asserted  that  information  must  focus  on 

27 

key  tasks  and  decisions.  Keen  concluded  that  the  cri¬ 
teria  for  design  must  come  from  managers  as  they  ask  four 

28 

fundamental  questions. 

1.  What  is  the  decision  or  task? 

2.  How  does  the  manager  carry  it  out? 

3.  What  information  does  he  or  she  use?  In  what 
ways? 
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i 

4.  What  would  it  mean  to  make  this  process  more 

effective?  j 

Control  and  Quality  Assurance 

Clear  distinctions  are  not  always  made  among  the 

functions  of  management.  Daniel  argued  that  planning  and 

2  9 

control  were  the  primary  functions.  Organizing  and 

staffing  were  described  as  subsets  of  planning  based  on 

clearly  defined  goals  and  objectives.  Janke  stated  that 

directing,  actions  covering  the  range  of  human  coordination, 

was  a  subset  of  controlling  (maintaining)  progress  toward 
30 

objectives.  The  management  information  system  must 

support  the  manager  in  these  two  tasks. 

Merchant  stated  that  once  the  planning  function 

was  accomplished,  management's  primary  task  was  to  take 

3 1 

steps  to  insure  plans  were  carried  out  or  modified.  As 
tasks  are  performed,  decisions  are  needed  as  to  the  accept¬ 
ability,  appropriateness,  and  success  of  the  efforts. 

Merchant  reported  that  the  control  function  consisted  of 
32 

three  steps. 

1.  Establish  standards 
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2.  Measure  performance  against  standards 
5.  Correct  deviation  from  standards 

Merchant  concluded  that  the  key  task  in  control 


was  the 

ability 

to  measure  performance 

• 

Of  considerable  parallel 

to  this 

concept 

of 

control 

is  the 

process  of  qual i ty 

assurance 

as  it 

has 

evolved 

under 

the  direction  of  the 

Joint  Commission 

on 

Accreditation  of  Hospitals. 

There  shall  be  evidence  of  a  well  defined, 

organized  program  designed  to  enhance  patient 

care  through  the  ongoing  objective  assessment  of 

inpatient  aspects  of  patient  care  and  the  cor- 

33 

recti  on  of  identified  problems. 

Shiller  and  Behm  reported  the  use  of  audits  to 
control  quality  and  efficiency  of  all  aspects  of  food 
service  operations Their  approach  involved  four  steps. 

1.  Develop  criteria 

2.  Establish  standards 

3.  Measure  performance  against  criteria 

4.  Correct  deviation  from  standards. 
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Snyder  studied  the  application  of  control  and 
quality  assurance  in  the  commercial  (non-hospital)  environ¬ 
ment.  He  concluded  that  eighty  percent  of  the  problems 

encountered  in  food  service  operations  were  due  to  the  lack 

35 

of  a  management  system  to  monitor  and  anticipate  problems. 


Merchant  asserted, 

Perfect  control,  meaning  complete  assurance  that 
actual  accomplishment  will  proceed  according  to 
plan,  is  never  possible  because  of  the  likely 
occurrence  of  unforeseen  events.  However,  good 
control  should  mean  that  an  informed  person  could 
be  reasonably  confident  that  no  major  unpleasant 
surprises  will  occur. 

Merchant  proposed  categories  of  responses  when 

problems  could  not  be  avoided  through  automation,  central- 

37 

ization,  risk-sharing  and  elimination.  These  categories 

of  responses  are  based  on  the  object  of  the  control.  That 

is,  controls  are  exercised  over  specific  actions,  results, 
38 

or  personnel.  Table  1  depicts  some  common  controls 


classified  by  Merchant. 
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TABLE  1 

A  Control  Tool  Classification  Framework 


Object  of  Control : 


Specific  Actions 

Resul ts 

Personnel 

Behavioral  Constraint: 

Results  Accountability: 

Upgrade  Capabilities: 

-Physical  (e.g.,  locks. 

-Standards 

-Selection 

security  guards) 

-Ejdget 

-Training 

-Administrative  (e.g.. 

-Management  by 

-Assignment 

separation  of  duties) 

Actioi  Accountability: 
-Work  Rules 
-Policies  and 

Procedures 

Codes  of  Conduct 

Preaction  Review 
-Direct  Supervision 
-Approval  Limits 
-Budget  Reviews 

Objective  (MBO) 

Improve  Communication: 
-Clarity  Expectations 
-Provide  Information  for 
Coordination 

Encourage  Peer  Control : 
-Work  Groups 
-Share  i  Goals 

SOURCE:  Kenneth  A.  Merchant,  "The  Control  Function  of  Management," 
Sloan  Management  Review  23  (Summer  1982),  p.45. 


twmt.-JH/ttmn 
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Two  limiting  factors  exist  which  determine  the 

39 

optimal  feasible  type  of  control.  The  first  is  the 
ability  to  measure  results.  In  his  decision  making  model 
(see  Figure  2),  Mason  described  this  as  " Predition  and  In¬ 
ference."  The  second  factor  is  the  knowledge  of  which 
specific  actions  are  desirable.  This  is  equated  with 
Mason's  "Values  and  Choices."  A  matrix  structure  is  pre¬ 
sented  in  Figure  4  to  facilitate  choice  of  control. 


KEY  CONTROL  FEASIBILITY  DETERMINATION 


Ability  to  Measure  Results 
On  Important  Performance  Dimensions 


HIGH 

LOW 

Knowledge  of 

Speci f i c-Acti on 

Specific 

Whi  ch 

Excel  lent 

and/or 

Action 

Specific 

Actions 

Resuits  Control 

Control 

Are 

Desi rabl  e 

Poor 

Results  Control 

Personnel 

Control 

Fig.  4.  Key  Control  Object  Feasibility  Determinants 


SOURCE:  Kenneth  A.  Merchant,  "The  Control  Function  of 

Mangement,"  Sloan  Management  Review  23 
(Summer  1982') ,  "p.4  7. 


WOT  I  fe-nmi  f^yyi  ^,TMOI"y«WTraOTWIiir»Tiia 
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Computerization 

Erroneous  conclusions  a  re  made  that  management 

information  systems  are  computerized  systems.  Gorry  and 

Morton  asserted  that  despite  the  tremendous  growth  in  the 

use  of  computers,  few  of  the  resulting  systems  have  signi- 

40 

ficantly  impacted  management's  decision  making.  Dearden, 

McFarlon,  and  Zani  concluded  that  the  important  functions  of 

4 1 

top  management  were  never  on  the  computer.  Rockart  stated 

that  this  resulted  from  the  failure  to  identify  the  needs  of 

managers.42  The  vital  concern  is  not  whether  computers  will 

be  used  to  facilitate  data  manipulation  but  rather  the 

43 

determination  of  those  needs. 

Youngwirth  presented  a  detailed  literature  review 

44 

on  the  evolution  of  computers  in  food  services.  The 
literature  indicated  a  variety  of  computer  uses,  ranging 
from  forecasting  and  inventory  aids  to  continuing  education. 

No  specific  literature  was  found  which  described 
the  Identification  of  Information  needs  of  dietitians  or 
food  service  managers  or  the  development  of  information 
systems  keyed  to  Identified  needs. 


Research  Methodology 

The  identification  of  critical  success  factors  Is 
accomplished  through  a  nominal  group  process  to  obtain  group 
consensus.  Because  of  the  impracticability  of  assembling  a 
representative  group  needed  for  this  study,  a  Delphi  process 
was  used. 

It  was  the  decision  of  this  researcher  that  the 
population  of  Army  dietitians  possessed  the  expertise  to 
best  determine  critical  sucrrss  f  :tors  for  Army  Nutrition 
Care  Division  operations. 

Delbecq,  Van  de  Ven  and  Gustafson  Indicated  that 

the  sample  size  for  a  homogeneous  participant  panel  should 

45 

be  between  ten  and  thirty.  Since  Army  dietitians  have 
relatively  similar  educational  and  experiential  backgrounds, 
they  were  considered  a  homogeneous  group.  One  dietitian 
from  each  of  the  thirty-four  Nutrition  Care  activities 
located  in  the  continental  United  States  was  selected  to 
participate  In  the  Delphi  panel.  The  selection  of  panel 
members  was  made  jointly  by  this  researcher  and  the  chiefs 
at  each  activity. 
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Telephone  interviews  were  conducted  with  most  of 
the  selected  dietitians.  Once  an  individual  agreed  to 
participate,  the  first  questionnaire  was  mailed  immediately 
accompanied  by  an  introductory  letter  (see  Appendix  E). 

Berdie  and  Anderson  have  reported  the  benefits  of 
personalized  correspondence  In  soliciting  responses  to 
questionnaires.  The  author  used  a  non-military  letter 
format  for  the  introductory  letter.  Letters  were  indivi¬ 
dually  typed  using  word  processing  equipment.  In  addition 
to  the  Introductory  letter,  an  Informal  note  using  Optional 
Form  41,  "Routing  and  Transmittal  Slip,"  was  Included  tc 
encourage  prompt  reply.  Preaddressed  envelopes  were  in¬ 
cluded  with  each  questionnaire. 

Delbecq,  Van  de  Ven  and  Gustafson  recommended  that 

a  deadline  of  two  weeks  be  given  for  the  receipt  of  the 
47 

response. 

The  Delphi  process  designed  for  this  study  con¬ 
sisted  of  three  questionnaires.  Questionnaire  #1  solicited 
general  success  areas  (see  Appendix  C).  In  Questionnaire 
#2,  participants  ranked  the  critical  categories,  determined 
the  degree  of  quality  assurance,  and  indicated  how  these 
categories  could  be  measured  (see  Appendix  D).  In  Ques¬ 
tionnaire  #3,  participants  re-ranked  the  critical  categories 
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(see  Appendix  E).  During  the  third  iteration,  panel  charac¬ 
teristics  were  solicited  using  a  separate  questionnaire  (see 
Appendix  F).  If  consensus  could  not  have  been  reached,  a 
fourth  questionnaire,  identical  to  the  third,  would  have 
been  developed  for  a  last  iteration. 

The  resultant  top  categories  were  used  as  the 
critical  success  factors  for  the  development  of  a  manage¬ 
ment  Information  system. 

A  literature  search  was  conducted  Into  the  nature 
of  each  factor.  Information  gleaned  from  the  literature 
search  and  the  comments  from  the  questionnaires  were  used  to 
Identify  prime  measures  for  ecc!.  factor. 

Once  the  critical  success  factors  and  their  prime 
measures  were  Identified,  on-site  research  was  conducted  at 
the  Nutrition  Care  Division,  Winn  Army  Community  Hospital, 
Fort  Stewart,  Georgia.  This  research  consisted  of  the 
identification  and  development  of  collection  methods  for 
prj,.>e  measure  data.  There  was  no  attempt  made  to  validate 
the  standards  developed  for  the  prime  measures. 

The  question  as  to  the  applicability  of  developing 
a  r-anagemerit  Information  system  using  this  critical  success 
factor  concept  Is  determined  by  the  attainment  of  the 
oitabl Ished  criteria. 
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II  DISCUSSION 


Panel  Characteri sties 


Thf.  .delphi  panel  consisted  of  thirty-four  Regis¬ 
tered  Dietitians.  At  some  hospitals,  dietitians  worked  as  a 
group  with  the  panel  member  acting  as  group  leader.  A 
majority  of  panel  members  were  Chiefs  of  Nutrition  Care 
Divisions.  Table  2  depicts  the  composition  of  the  delphl 
panel  by  current  position. 


TABLE 

PANEL  COMPOSITION  BY 


2 

CURRENT  POSITION 


CURRENT  POSITION 


NUMBER  PERCENT 


Chief,  Nutrition  Care  Division  26  78.8 
Chief,  Clinical  Dietetic  Branch  5  15.1 
Chief,  Production  and  Service  Branch  0  0.0 
Other  2  6.1 

TOTAL  7J  100.0 


( 

*  , 


29 


'•UtiVAMt* 
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Thi rty-three ,  or  97.1  percent,  of  the  thirty-four 
panel  members  eventually  completed  their  participation  in 
the  del  phi  process.  On  the  first  iteration,  twenty-seven 
responses  were  received  prior  to  analysis.  Eventually, 
thirty-one  replies  were  received.  On  the  second  iteration, 
twenty-six  panel  members  responded  prior  to  analysis. 
Eventually,  thirty  responses  were  received.  On  the  third 
iteration,  thirty-three  of  the  thirty-four  questionnaires 
were  returned  in  time  for  the  final  analysis.  Table  3 
summarizes  panel  response. 


TABLE  3 

PANEL  MEMBER  RESPONSE 


RETURNED 

EVENTUALLY 

1 1  ERA  1  ION 

ON  1 I  ME 

PERCENT 

RETURNED 

PERCENT 

1 

27 

79.4 

31 

91.2 

2 

26 

76.5 

30 

88.2 

3 

33 

97.1 

33 

97.1 

1 
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Panel  experience  was  measured  in  terms  of  educa¬ 
tion  level,  years  of  military  and  dietetic  experience,  and 
type  of  positions  held.  All  of  the  respondents  had  bac¬ 
calaureate  degrees  and  62.5  percent  had  postgraduate 
degrees.  Table  4  depicts  the  education  level  of  the  panel. 


TABLE  4 

EDUCATION  LEVEL  OF  PANEL  MEMBERS 


HIGHEST 

DEGREE 

NUMBER 

PERCENT 

Baccal aureate 

12 

36.36 

Masters 

19 

57.58 

Doctoral 

2 

6.06 

TOTAL 

33' 

1 00. -O'O' 

The  distribution  of  years  of  experience  in  both 
dietetics  and  the  military  is  depicted  in  Table  5.  The 
panel  had  means  of  11.9  and  11.6  for  years  of  dietetic 
experience  and  years  of  military  experience,  respectively. 
Actual  dietetic  experience  ranged  from  1.5  years  to  21.5 


years. 
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TABLE  5 

PANEL  MEMBER  EXPERIENCE 


TYPES  OF  EXPERIENCE 


YEARS  OF  Dietetic _ Military 


EXPERIENCE 

No . 

0/ 

/o 

No . 

% 

0-  4.9 

6 

18.18 

5 

15.15 

5-  9.9 

8 

24.24 

8 

24.24 

10-14.9 

6 

18.18 

8 

24.24 

15-19.9 

10 

30.30 

9 

27.27 

20+ 

_3 

9.10 

3 

9.10 

TOTAL  33 

100.00 

33 

100.00 

Table  6  depicts  the  array  of  positions  exper¬ 
ienced  by  panel  members.  Over  87  percent  of  the  panel 
members  had  experience  as  Chief  of  a  Nutrition  Care  Divi¬ 
sion.  Slightly  over  75  percent  had  been  in  charge  of 
Clinical  Dietetic  Branches  and  almost  67  percent  had  been 
in  charge  of  Production  and  Service  Branches.  The  panel 
had  a  well-rounded  experience  base  from  both  branches. 


TABLE  6 


EXPERIENCES  OF  PANEL  MEMBERS 


POSITION 

NUMBER 

PERCENT 

87.88 
75.76 
66.67 
78.79 
36.36 
6. .06 

When  asked  if  they  considered  themselves  admini¬ 
strative  or  clinical  dietitians,  63.6  percent  indicated 
admi ni strati ve ,  18.2  percent  indicated  clinical,  and  18.2 

percent  indicated  both. 

Rank  and  sex  information  was  solicited  to  deter¬ 
mine  if  the  panel  was  a  representative  sample  of  Army 
dietitians.  Results  are  illustrated  in  Figures  5  and  6; 
and  based  on  Chi  square  tests,  it  can  be  stated  that 
distributions  of  rank  and  sex  among  the  panel  members  did 
not  differ  significantly  from  the  distributions  of  rank  and 
sex  among  the  population  of  Army  dietitians.  Tables  7  and 
8  depict  the  results  of  these  tests. 


Chief,  Nutrition  Care  Division 
Chief,  Clinical  Dietetic  Branch 
Chief,  Production  and  Service  Branch 
Staff  Clinical  Dietitian* 

Staff  Production  Dietitian 
Other 


♦Includes  Clinic  Dietitian 
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TABLE  7 

CHI  SQUARE  TEST  FOR  INDEPENDENCE  OF  RAf K  * 


LT 

CPT 

MAJ 

LTC 

COL 

POPULATION 

39 

62 

44 

16 

6 

(35.9) 

(60.1) 

(47.6) 

(17.5) 

(5.8) 

PANEL 

4 

in 

13 

5 

1 

(7.1) 

(11.9) 

(9.4) 

(3.5) 

(1.2) 

* 


Hq :  No  difference  between  the  two 

H^:  Difference  exists  between  the 

CRITICAL  X2  at  alpha  =  .10  and 
=  7.779 


distributions, 
two  distributions. 

4  degrees  of  freedom 


CALCULATED  X2  =  4.458 


Unable  to  reject  Hq 


1 


i 

I 

1 

I 
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TABLE  8 

CHI  SQUARE  TEST  FOR  INDEPENDENCE  OF  SEX  *  S 


FEMALE  MALE 

POPULATION  131  36 

(131.1)  (35.9) 

PANEL  26  7 

(25.9)  (7.1) 


*  Hq:  No  difference  between  the  two  distributions. 

H^:  Difference  exists  between  the  two  distributions. 

CRITICAL  X2  at  alpha  *  .10  and  1  degree  of  freedom  e 
2.706 

CALCULATED  X2  =  .035 
. * .  Unable  to  reject  Hq 
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Results/Analysis  of  Questionnaire  #  1 

Twenty-seven  panel  members  returned  their  ques¬ 
tionnaires  in  time  for  analysis.  Responses  varied  from 
identification  of  general  areas  to  specific  problem  areas. 
One  panel  member  identified  specific  policies  needed  In 
various  areas  of  the  Nutrition  Care  Division.  All  re¬ 
sponses  were  given  full  consideration.  The  analysis 
consisted  of  consolidating  like  responses  Into  categorical 
areas  of  concern.  The  analysis  resulted  In  38  areas  of 
concern  which  are  Identified  in  Table  9. 

Four  other  questionnaires  received  after  analysis 
were  analyzed  but  did  not  result  In  the  creation  of  any  new 
areas . 

The  38  areas  were  consolidated  from  the  total  of 
405  areas  identified  by  31  panel  members.  The  mean  number 
of  areas  Identified  per  panel  member  was  13.1. 
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TABLE  9 

AREAS  OF  CONCERN  IDENTIFIED  FROM  QUESTIONNAIRE  #1 


AREA  OF  CONCERN 


1.  Fiscal  Responsibility  (Subsistence) 

2.  Fiscal  Responsibility  (Nonfood  Supply) 

3.  Inventory  and  Subsistence  Management 

4.  Quality  of  Diet  Instructions  (Inpatients  and  Outpatients) 

5.  Army  Weight  Control  Responsibilities  (Includes  performing 
sklnfolds) 

6.  Operation  of  Diet  Clinic  (hours,  waiting  times,..) 

7.  Nutritional  Assessments 

8.  Wnt'ng  of  Modified  and  Special  Diets 

9.  Inpatient  Interviews 

10.  Documentation  of  Nutritional  Care 

11.  Sanitation  (Includes  Personal  Hygiene) 

12.  Equipment  Maintenance  and  Replacement 

13.  Quality  and  Accuracy  of  Patient  Trays 

14.  Quality  of  Dining  Room  Meals  and  Service 

15.  Appropriate  Provision  of  Nutritional  Education 
16..  Food  Preparation  (Includes  pre-prep  and  pastry) 


.iffE 


n  Trot1 


itmm 


BidSSBmBS 


aa 
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TABLE  9  -  Continued 


AREA  OF  CONCERN 


17.  Accuracy  of  Food  Preparation  Forecasts 

18.  Standardization  and  Maintenance  of  Recipes 

19.  Utilization  of  Leftovers 

20.  Ingredient  Room  Operation 

21.  Menu  (Adequacy,  Variety) 

22.  Other  Production  and  Service  Branch  Operations 

23.  Other  Clinical  Dietetic  Branch  Operations 

24.  Administrative  Requirements  (Suspenses,  SOP  updates. 
Filing...) 

25.  Labor  -  Management  Relations 

26.  Headcount  Procedures 

27.  Availability  of  Subsistence  Items 

28.  Availability  of  Personnel 

29.  Inservice  Training 

30.  Safety  Program 

31.  Employee  Morale 

32.  Personnel  Administration  (52s,  Performance  Standards) 

33.  Personnel  Management  (Supervision,  Counseling) 

34.  Scheduling  and  Attendance  of  Personnel 


-rw 


41 


Y, 


TABLE  9  **  Continued 


AREA  OF  CONCERN 


35.  Preparation  of  Tube  Feeding  and  Enteric  Nourishments 

36.  Cost  of  Nourishments 

37.  Security 

38.  Relationships  with  Other  Activities _ 
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A  review  of  the  38  areas  reveals  some  areas  of 
concern  which  seem  to  overlap.  For  example,  personnel 
management,  personnel  administration,  labor-management 
relations  and  employee  morale  are  considerably  interrelated. 
During  analysis,  comments  from  panel  members  drew  clear 
distinctions.  Personnel  management  represents  the  rela¬ 
tionship  between  a  supervisor  and  employees  and  involves 
management  style,  motivation,  and  human  relations.  Per¬ 
sonnel  administration  involves  those  administrative  tasks 
associated  generally  with  paperwork,  Including  completion  of 
Standard  Form  52  (Request  for  Personnel  Action),  Standards 
of  Performance,  Interviewing,  and  selecting  new  personnel. 
Labo'-management  relations  pertains  to  the  relationships 
between  the  labor  union  and  management  Including  contract 
negotiation  and  administration.  Finally,  employee  morale, 
which  implicitly  results  from  effective  personnel  manage¬ 
ment,  was  explicitly  listed  by  a  sufficient  number  of 
respondents  to  warrant  a  separate  catagory.  Similar  over¬ 
lapping  existed  In  several  areas;  however.  In  all  areas 
comments  from  panel  members  provided  Justification  for 
distinct  areas. 


-  7.**^ « r 
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Twenty-six  Questionnaires  #2  were  returned  In  time 
for  analysis.  There  were  three  .sets  of  results  obtained 
from  this  Iteration.  First,  a  preliminary  ranking  of  the  38 

i  ■ 

areas  facilitated  the  final  development  of  Questionnaire  #3. 
These  results  are  depicted  in  Table  10. 

Second,  considerable  data  were  collected  on  how 
to  measure  success.  These  data  were  used  In  the  development 
of  management  Information  system  elements  for  the  critical 
success  factors.  Third,  data  were  collected  on  the  relative 
Importance  of  the  areas  regarding  quality  assurance.  Table 
11  depicts  the  quality  Assurance  average  weighted  scores  and 
resultant  ranking.  A  slight  variation  Is  achieved  when 
areas  are  ranked  by  percentage  as  depicted  In  Table  12, 


44 


TABLE  10 


PRELIMINARY 

RANKING  OF  AREAS  OF  CONCERN 

PRELIMINARY  RAW 

AREA  OF  CONCERN 

RANK 

SCORE 

1 

183 

Financial  Responsibility  (Subsistence) 

2 

147 

Quality  and  Accuracy  of  Patient  Tray 

Service 

3 

105 

Quality  of  Dining  Hall  Meals  and  Service 

4 

104 

Inventory/Subsl stence  Management 

j 

99 

Documentation  of  Nutrition  Care 

6 

85 

Quality  of  Diet  Instruction 

7 

69 

Sanl tation 

fl 

65 

Personnel  Management 

9 

58 

Writing  of  Special  Modified  Diets 

10 

49 

Appropriate  Provision  of  Nutritional 

Education 

10 

49 

Army  Weight  Control  Program 

Responsibl 1 i ties 

12 

43 

Fiscal  Responsibilities  (Nonfood) 

13 

41 

Food  Preparation 
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TABLE  10  -  Continued 


PRELIMINARY 

RANK 

RAW 

SCORE 

AREA  OF  CONCERN 

14 

39 

Nutritional  Assessments 

15 

37 

Menu 

16 

34 

Equipment  Maintenance  and  Replacement 

Program 

17 

32 

Availability  of  Personnel 

18 

28 

Headcount  Procedures 

19 

18 

Employee  Morale 

20 

17 

Personnel  Administration 

21 

15 

Operation  of  Diet  Clinic 

22 

14 

Security 

22 

14 

Administrative  Requirements 

22 

14 

Inpatient  Interviews 

25 

11 

Inservice  Training 

26 

9 

Availability  of  Subsistence 

27 

8 

Preparation  of  Tube  Feedings/Enteric 

Feedings 

27 

8 

Labor/Management  Relations 

27 

8 

Utilization  of  Leftovers 

30 

7 

Accuracy  of  Forecasts 
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TABLE  10  -  Continued 


PRELIMINARY 

RANK 

RAW 

SCORE 

AREA  OF  CONCERN 

30 

7 

Standardization/Maintenance  of  Recipes 

30 

7 

Scheduling/Attendance  of  Personnel 

33 

4 

Relationships  with  Outside  Activities 

34 

1 

Safety 

35 

0 

Ingredient  Room  Operation 

35 

0 

Cost  of  Nourishments 

35 

0 

Other  C.D.B  Functions 

35 

0 

Other  P  &  S  Functions 

V 
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Results/Analysis  of  Questionnaire  #3 
On  the  final  iteration,  thirty-three  panel  members 
responded  in  time  for  analysis.  A  thirty-fourth 

questionnaire,  received  after  analysis,  was  discounted 
because  it  had  not  been  properly  completed.  Table  13 
depicts  the  final  ranking  of  the  38  areas. 

An  analysis  of  the  total  raw  scores  gave  credence 
to  a  conclusion  that  there  were  eight  critical  success 
factors  instead  of  five.  First,  the  greatest  disparity 
among  the  areas  existed  between  the  eighth  and  ninth  areas. 
Second,  the  top  eight  areas  were  all  ranked  in  the  top  eight 
by  at  least  sixty  percent  of  the  respondents  satisfying 
established  criteria.  Table  14  depicts  the  ranking  of  the  < 
eight  critical  success  factors. 


TABLE  13 


FINAL  RANKING  OF  AREAS  OF  CONCERN 


rPIM: 

■bh 

AREAS  OF  CONCERN 

1 

257 

Fiscal  Responsibility  (Subsistence) 

2 

254 

Quality  and  Accuracy  of  Patient  Trays 

3 

187 

Quality  of  Dining  Hall  Meals  and  Service 

4 

148 

Documentation  of  Nutritional  Care 

5 

147 

Inventory  and  Subsistence  Management 

6 

115 

Personnel  Management 

7 

114 

Sanitation 

8 

112 

Quality  of  Diet  Instructions 

9 

57 

Appropriate  Provision  of  Nutrition  Education 

10 

56 

Writing  Special  and  Modified  Diets 

11 

54 

Army  Weight  Control  Program  Responsibilities 

12 

39 

Fiscal  Responsibilities  (Nonfood) 

13 

27 

Food  Preparation 

14 

26 

Menu 

15 

23 

Nutritional  Assessments 

15 

23 

Equipment  Maintenance/Replacement  Program 

17 

16 

Securi ty 

18 

15 

Employee  Morale 

19 

13 

Availability  of  Personnel 

19 

13 

Headcount 

21 

9 

Accuracy  of  Forecasts 

22 

7 

Inservice  Training 

23 

6 

Availability  of  Subsistence  Items 

23 

6 

Personnel  Administration 

25 

5 

Operation  of  Diet  Clinic 

25 

5 

Labor-Management  Relations 

25 

5 

Standardl zatlon  and  Maintenance  of  Recipes 

28 

3 

Admi nistratlve  Requir ements 

29 

1 

Utilization  of  Leftovers 

29 

1 

Relationships  with  Outside  Activities 

29 

1 

Saf ety 

32 

0 

Scheduling  and  Attendance  of  Personnel 

32 

0 

Preparation  of  Tube  Feedings  anu  Enteric 

Nourl shments 

32 

0 

Cost  of  Nourishments 

32 

0 

Ingredient  Room  Operation 

32 

0 

Inpatient  Interviews 

32 

0 

Other  Clinical  Dietetic  Operations 

32 

0 

Other  Production  Operations 

CRITICAL  SUCCESS  FACTORS  AS  RANKED  BY  RESPONDENTS 


51 


CO 

i 


co 


VO 


o 

LU 


to 


< 

oc 


to 

CM 


oo 


to 

CM 


CO 

CM 


CM 

CM 


O 

CM 


CO 


CM 


O  •— I 


CM 


to 


CM 


LO 


CO 


CM 


CO 


in 


co 

CM 


CM 


in 

o 

CO 

to 

CM 

Ha- 

co 

«tj- 

rH 

oo 

CO 

HJ- 

in 

rH 

CO 

co 

o 

Hj- 

rH 

CM 

CO 

HJ" 

rH 

CM 

»— 1 

CM 

CM 

•O" 

CM 

rH 

o 

rH 

CM 

rH 

CM 

HJ- 

rH 

rH 

rH 

o 

o 

o> 

>. 

u 

1 

4-> 

>t 

•r— 

1/5 

4-> 

•F 

u 

> 

•F 

c 

r» 

<0 

1. 

to 

O' 

•r- 

t- 

C71  0) 

£> 

E 

jO 

3  (O 

C  00 

4- 

3  4J 

0) 

•f 

o  >0 

O 

00  C 

cn 

1/1 

u  n 

C  -O 

a 

<D 

IO 

C  • — ■ 

<  t. 

•r-  C 

c  w 

■D  E 

e 

O  0J 

h- 

O  (d 

O  <0 

C  Ol 

<o 

Q.  'J 

-o 

•F  U 

<0  CO 

X 

to  c 

C  4-> 

4-  to 

-*-> 

CO 

c 

01  Ol 

>0  C 

O  — 

<o  c 

>1  C 

r— 

o 

a;  h-> 

01 

net 

■M  O 

W  *0 

a 

•F 

to 

>1 

^  <0 

C  •(- 

O  X 

c 

r —  *f- 

H->  +J 

•u  £ 

0J  4-> 

+■> 

c 

<0 

cn 

<o  to 

•i—  ro 

•f 

£  T- 

C  01 

o 

4J 

o 

U  XI 

r—  Q. 

F»  r— 

3  t- 

IV  o 

to 

•F 

t- 

to  3 

10 

IO  r— 

O  4-> 

>  c 

t- 

c 

o 

•i-  00 

3  4- 

3  <0 

O  3 

C  01 

a> 

10 

<c 

u.  >■— - 

O'  O 

as 

O  Z 

►H  +j 

a. 

oo 

to 


o 

CM 


in 


co 


co 


co 


00 


Quality  of  Diet 
Instructions 


52 


Correlation  of  Areas 

It  was  suggested  that  critical  success  factors 
could  be  used  to  develop  quality  assurance  programs.  To 
evaluate  this  suggestion,  Spearman  rho  Rank  Correlation 
tests  were  performed  correlating  the  final  ranking  from 
Questionnaire  #3  (see  Table  13)  with  the  two  Quality 
Assurance  rankings  (see  Tables  11  and  12).  The  results  are 
r  (rhc)  e  .628  and  .377  respecti vely .  Both  are  significant 
at  alpha  =  .05.  Appendix  G  contains  pertinent  Information 
concerning  these  tests. 


Critical  Success  Factors 

literature  review,  written  comments  from  panel 
members,  and  direct  observations  within  a  Nutrition  Care 
Division  Indicate  that  all  eight  critical  success  factors 
can  be  measured  and  that  adequate  data  collection  Is  achiev¬ 
able. 

The  most  Important  area  Identified  for  success  Is 
the  proper  management  of  subsistence  funds.  Army  Regula¬ 
tions  provide  a  cost  accounting  system  which  outputs  a 
number  of  completed  forms  and  reports.*  Adequate  data 
collection  Is  provided.  The  goal  of  the  cost  accounting 
system  is  to  assist  the  manager  In  assessing  the  ability  of 
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the  Nutrition  Care  Division  to  afford  the  menu  and  serving 
practices.  A  standard  on  which  to  base  measurement  would 
be:  At  the  end  of  each  month  (and  fiscal  year),  the  Actual 
Expenditures  for  Subsistence  will  not  exceed  the  Monetary 
Allowance  for  Subsistence.  By  comparing  performance  over 
several  months,  the  dietitian  can  determine  If  correction  Is 
needed.  A  range  of  discretionary  responses  Is  available 
Including  modifying  the  menu,  reducing  leftovers,  altering 
portion  sizes,  and  modifying  the  seconds  policy.  Within  the 
monthly  accounting  period,  this  system  can  be  monitored  by 
keeping  the  required  forms  up-to-date  and  by  projecting 
Income  and  expenses.  Respor.ses  during  monthly  periods  gene¬ 
rally  Involve  modifying  requisition  quantities,  but  Include 
all  responses  Identified  above. 

The  patient  tray  system  provides  diets,  both 
regular  and  modified,  as  prescribed  by  the  attending  physi¬ 
cian.  The  goals  of  the  system  Include  the  following. 

1.  The  patient  gets  the  tray  Intended  for 

him/her. 


2.  The  tray  contains  the  appropriate  Items  In 
accordance  with  dietary  restrictions  and  patient 
preference . 

3.  The  quality  of  the  food,  as  measured  by 
appearance,  temperature,  and  taste,  meets  patient 
expectations  to  facilitate  consumption. 

Several  measurements  have  been  Identified. 

Schiller  and  Behm  described  the  use  of  administrative  audits 

2 

to  measure  accuracy  and  temperature.  One  type  of  admini¬ 
strative  audit,  using  periodic  dummy  trays,  was  suggested  by 
a  panel  member.  Satisfaction  surveys  have  been  used  to 
measure  accuracy,  appearance,  temperature,  and  taste.  The 
use  of  satisfaction  surveys  has  been  encouraged  by  the  Joint 

3 

Commission  on  Hospital  Accreditation.  Despite  the  frequent 
questioning  of  the  validity  of  results  from  questionnaires, 

4 

trends  are  often  dlscernable  from  survey  data.  Baseline 
data  can  be  gathered  on  a  more  frequent  basis  when  super¬ 
visors'  dally  observations  are  recorded  on  checklists.  Data 
can  be  collected  relatively  easily  with  all  of  these 
methods . 
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The  dining  hall  or  cafeteria  system  has  a  goal  of 
providing  patron  satisfaction.  Classic  measurement  of  this 

5 

system  has  been  headcount.  Decreasing  headcount  trends 
generally  Indicate  diminished  quality  of  food,  service,  or 
both.  Increasing  headcount  trends  give  the  opposite  Indi¬ 
cation.  Administrative  audits,  supervisor  checklists,  and 
satisfaction  surveys  can  all  be  used. 

Documentation  of  nutritional  care  primarily 
involves  documenting  patient  dietary  matters  In  the 
inpatients  treatment  records.  This  area  overlaps  with 
"quality  of  diet  Instruction,"  as  the  documentation  of  diet 
Instructions  Is  Important  as  a  measure  of  quality.  In  both 
areas,  measurement  Is  recommended  In  the  form  of  record 
audits.  Although  the  Joint  Commission  on  Accreditation  of 
Hospitals  no  longer  specifically  requires  audits  of  patient 
records,  hospitals  continue  to  utilize  this  method.  Many 
Army  Nutrition  Care  Divisions  have  adopted  nutrition  care 
plans  which  contain  audit  criteria. 

The  inventory  and  subsistence  management  area  Is 
highly  related  to  fiscal  responsibility.  However,  the 
distinct  goal  of  this  system  Is  to  provide  needed  subsis¬ 
tence  items  In  the  quantities  needed  and  at  the  time 


2  Wggg. 
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needed.  Clearly  success  is  measured  by  how  often  the  system 
meets  the  demands  placed  on  It.  This  demand  satisfaction 
can  be  measured  by  using  DA  Form  2S30,  Kitchen  Requisition, 
as  a  source  document. 

The  personnel  management  area  Involves  the  em¬ 
ployee  system.  Its  goal  Is  to  have  employees  who  are  highly 
motivated  toward  the  achievement  of  organization  objectives. 
The  use  of  employee  questionnaires  results  In  both  data 
collection  and.  In  theory,  Increased  morale  through  the 
Hawthorne  effect.  More  objective  data  can  be  drawn  from 
employee  complaints  and  grievances,  and  from  sick  leave 
usage . 

The  goal  of  sanitation  Is  to  prevent  food  borne 
and  food  transmitted  diseases  through  the  proper  use  of 
sanitation  principles.  Data  can  be  drawn  from  either 
Internal  or  external  Inspection  checklists.  The  measure  of 
success  Is  the  absence  of  sanitary  deficiencies  as  noted  by 
satisfactory  ratings. 

While  the  development  of  a  management  Information 
system  was  not  a  stated  objective  of  this  study.  Information 
concerning  the  eight  critical  success  factors  have  been 
assembled  Into  a  management  information  system  as  described 
in  Figures  7  -  14. 
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FISCAL  RESPONSIBILITY 
(Subsistence) 


SYSTEM:  Subsistence  procurement  and  cost  accounting 

SYSTEM  GOAL:  Ensure  financial  viability. 

SYSTEM  STANDARD:  At  the  end  of  each  month  (and/or  fiscal 
yearj  and  after  adjustment  for  inventory  gain/ 
loss,  the  actual  expenditures  for  subsistence  will 
not  exceed  the  monetary  allowance. 

DATA  SOURCE:  Draw  data  from  DA  Form  1836,  HSC  Report  (RCS 

Tl4),  DD  160,  Cost  Accountant  Projections  for  DA 
Forms  3161  and  Rations  Earned. 

MEASUREMENT :  Observe  trends  over  several  months  to  deter¬ 
mine  action  for  fiscal  year  close.  Observe 
projections  from  cost  accountant  for  monthly 
close. 

RESPONSES :  Results  Control  -  Range  of  Actions  Including 

modifying  menu,  portion  sizes,  and  policy  on 
seconds,  and  Improving  forecasts  to  reduce  waste 
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QUALITY  AND  ACCURACY  QF  PATIENT  TRAYS 


SYSTEM :  Patient  tray  service 

SYSTEM  GOAL:  Patient  satisfaction  within  required  nutri¬ 
tional  limitations. 

SYSTEM  STANDARD:  1.  Ninety  percent  of  patients  will  be 

sati sf ied  with  patient  tray  service  regarding 
appearance,  temperature,  and  taste  of  food. 

2.  Ninety-five  percent  of  patients  will 

have  accurate  trays. 

DATA  SOURCE:  Draw  data  for  patient  satisfaction  from 

patient  survey  conducted  at  least  monthly.  Draw 
data  for  accuracy  from  administrative  tray  audits 
held  at  least  monthly. 

MEASUREMENT :  Calculate  percentages.  Observe  trends  in 
percentages . 

RESPONSES :  1.  Personnel  Control  -  Range  of  Actions  in¬ 
cluding  training,  clarifying  expectations, 

providing  Information,  and  encouraging  peer 

control . 

2.  Specific  Action  Control  -  Range  of  Actions 
Including  behavior  constraints  (disciplinary 

actions,  performance  standards),  action 
accountability  (policies)  and  preaction  review 
(improved  supervision). 


Fig.  8.  Overview  of  Management  Information  System  Element 
for  Quality  and  Accuracy  of  Patient  Trays. 


QUALITY  OF  DINING  HALL  MEALS  AND  SERVICE 


SYSTEM ;  Cafeteria  Service 

SYSTEM  GOAL:  Patron  satisfaction. 

SYSTEM  STANDARD:  Eighty  percent  of  the  dining  hall  patrons 
are  satisfied  with  appearance,  temperature,  and 
taste  of  food,  and  with  service. 

DATA  SOURCE:  Draw  data  for  patron  satisfaction  from  monthly 
satisfaction  survey. 

MEASUREMENT :  Calculate  percentages.  Observe  trends  in 

percentages . 

RESPONSES ;  Specific  Action  Control  -  Range  of  Actions 

including  preaction  review  (improved  supervision) 
and  behavioral  constraints  (performance 
standards) . 


Fig.  9.  Overview  of  Management  Information  System  Element 
for  Quality  of  Dining  Hall  Meals  and  Service. 
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DOCUMENTATION  OF  NUTRITIONAL  CARE 


SYSTEM :  Nutritional  Care  of  Inpatients 

SYSTEM  GOAL:  App  jpriate  dietetic  information  shall  be 
recorded  in  the  patient's  medical  record. 

SYSTEM  STANDARD:  Ninety  percent  of  the  inpatient  treatment 
records  (ITRs)  will  contain  appropriate  dietetic 
information  as  delineated  by  designated  nutrition 
care  plans. 

DATA  SOURCE:  Draw  data  from  audit  of  ITRs. 

MEASUREMENT :  NOTE:  Consideration  must  be  given  to  degree 

of  compliance  if  audit  performed  is  concurrent. 
Calculate  percentage.  Observe  trends. 

RESPONSES :  Personnel  Control  -  Range  of  Actions  including 

training,  assignments,  and  encouragement  of  peer 
control . 


Fig.  10.  Overview  of  Management  Information  System  Element 
for  Documentation  of  Nutritional  Care. 
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INVENTORY  AND  SUBSISTENCE  MANAGEMENT 


SYSTEM:  Subsistence  Management. 


SYSTEM  GOAL:  Subsistence  items  will  be  available  when 


needed  and  in  the  quantity  required. 


SYSTEM  STANDARD:  Ninety-five  percent  of  the  subsistence 

items  will  be  available  when  needed  and  in  the 
quantity  required. 


DATA  SOURCE:  Draw  data  from  DA  2930s  or  appropriate  com¬ 


puter  printout  if  automated  ( e . g .  ,  ingredient  room 
summary ) . 


MEASUREMENT :  Calculate  demand  satisfaction  percenLage  by  the 
TormuTal 


Demand 

Sati sf acti cn 


Number  of  Lines  Iss1 


100 


Number  of  Lines  Requested 
Observe  trends  in  data. 

RESPONSES :  Results  Control  -  Results  Accountability, 


Fig.  11.  Overview  of  Management  Information  System  Element 
for  Inventory  and  Subsistence  Management. 
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PERSONNEL  MANAGEMENT 


SYSTEM:  Employee  system 

SYSTEM  GOAL:  Employees  are  highly  motivated  towards 
~~  achievement  of  organization  objectives. 

SYSTEM  STANDARD:  Personnel  work  toward  organization  objec¬ 
tives  without  complaint. 

DATA  SOURCE:  1.  Periodic  employee  questionnaires. 

?.  Number  and  Frequency  of  formal  and 
i nf orma 1  complaints /grievances. 

3.  Sick  leave  usage. 

MEASUREMENTS :  Make  subjective  review  of  questionnaire 

comments.  Observe  trends  in  percentage  of 
responses  on  questionnaires.  Observe  trends  in 
number  of  complaints.  Observe  trends  in  sick 
leave  usage. 

RESPONSES:  Personnel  Control  -  Range  of  Action  including 

Upgrade  Capabilities  (selection,  training  and 
assignment)  and  improve  communications.  Other 
types  of  contro1  may  be  appropriate  on  a  case 
by  case  basis. 


Fig.  1?.  Overview  of  Management  Information  System  Element 
for  Personnel  Management. 
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SANITATION 


SYSTEM:  Sanitation  Subsystem 

SYSTEM  GOAL:  Prevent  food  borne  illnesses, 

SYSTEM  STANDARD:  Satisfactory  rating  will  be  received  on 

aTl  Preventive  Medicine  Service  Sanitary 
Inspections. 

DATA  SOURCE:  Completed  inspection  checklist. 

MEASUREMENT :  ODserve  results  of  inspection.  Observe  trends. 

RESPONSES :  Both  Specific  Action  and  Results  -  Range  of 

Action  including  standards,  preaction  review 
(direct  supervision),  action  accountabi 1 i ty  (work 
rules  and  policies),  and  behavioral  constraints 
( admin i strati ve) . 


Fig.  13.  Gverview  for  Management  Information  System  Element 
for  Sanitation. 
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QUALITY  OF  DIET  INSTRUCTIONS 


SYSTEM :  Diet  Instruction 

SYSTEM  GOAL:  Patient  can  verbalize  diet  principles. 

SYSTEM  STANDARD:  Ninety -five  percent  of  patients  receiving 

instructions  are  able  to  verbalize  princinles 
of  diets. 

DATA  SOURCE:  Draw  data  from  patient  medical  record  (both 
inpatient  and  outpatient  audit). 

MEASUREMENT :  Calculate  percentage.  Observe  trends. 

RESPONSES :  Personnel  Control  -  Range  of  Actions  including 

training,  assignment,  and  er.~ouragement  of  peer 
control . 


Fig.  14.  Overview  of  Management  Information  System  Element 
for  Quality  of  Diet  Instruction. 
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II!  CONCLUSION  AND  RECOMMENDATION 


Conclusion 


It  was  concluded  that  the  critical  success  factor 
concept  was  viably  applicable  for  use  in  developing  a 
management  information  system  for  use  in  U.S.  Army  hospital 
Nutrition  Care  Divisions. 

The  literature  inferred  that  the  failure  of  most 
management  information  systems  was  due  to  the  improper 
identification  of  the  manager's  real  information  needs.  The 
literature  revealed  the  weaknesses  of  the  four  primary 
methods  of  identifying  needs  and  the,  strength  of  the 

I 

critical  success  factor  concept.  Literature  indicated  that 
management  information  systems  should  facilitate  a  manager's 
ability  to  make  decisions,  evaluate  performance  towards  goal 
achievement,  and  be  developed  along  subsystem  lines. 
Literature  provided  models  for  development  of  management 
information  systems  and  a  construrt  for  determining  optimal 
control  methods. 
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Thirty-four  dietitians  were  selected  to 
participate  as  a  Delphi  panel.  Statistical  analysis  of  rank 
and  sex  distributions  inferred  that  the  panel  was  a 
representative  group  of  Army  dietitians.  The  panel  had  a 
well  rounded  experiential  and  educational  base. 
Thi rty-three ,  or  97.1  percent,  of  the  respondents  completed 
their  participation  in  the  Delphi  process. 

The  panel  identified  thirty-eight  areas  of  concern 
for  Nutrition  Care  Division  operations.  At  the  conclusion 
of  the  Delphi  process,  eight  of  these  areas  were  determined 
to  be  the  critical  success  factors.  The  critical  success 
factors,  as  ranked  by  at  least  60  percent  of  panel  members, 
were,  respectively,  fiscal  responsibility  in  the  area  of 
subsistence,  quality  and  accuracy  of  patient  tray  service, 
quality  of  dining  hall  meals  and  service,  documentation  of 
nutrition  care,  inventory  and  subsistence  management, 
personnel  management,  sanitation,  and  quality  of  diet 
i nstructions . 

Prime  measures,  data  sources,  and  collection 
methodology  were  identified  for  each  critical  success 
factor. 
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A  management  information  system  was  developed 
using  the  critical  success  factors,  their  prime  measures, 
and  the  collection  methodology.  The  information  system 
measures  performance  toward  goal  achievement  in  the  eight 
critical  success  areas.  While  standards  were  developed  for 
functional  and  illustrative  purposes,  standards  .'/ere  not 
validated  and  are  apt  to  vary  from  hospital  to  hospital.  To 
facilitate  the  decision  making,  feasible  control  responses 
were  identified  for  each  area. 

A  summary  of  this  research  is  being  forwarded  to 
each  panel  member.  Futher,  a  copy  of  this  paper  is  being 
forwarded  to  the  Chief  Dietitian,  Office  of  The  Surgeon 
General,  Washington,  D.C. 

As  measured  by  the  criteria,  the  objectives  of 
this  reseach  have  been  fully  accomplished.  The  critical 
success  factor  concept  was  found  to  be  viably  applicable  in 
developing  a  management  information  system  for  use  in  U.S. 
Army  hospital  Nutrition  Care  Divisions. 

Recommendati ons 

It  i s  recommended  that  the  critical  success  factor 
concept  be  utilized  to  develop  management  information 
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systems  for  use  in  Nutrition  Care  Divisions.  It  is 
recommended  that  further  study  be  performed  to  validate  the 
critical  success  factors  identified  in  this  research  and  the 
standards  proposed  for  those  areas.  It  is  recommended  that 
more  research  be  conducted  in  the  correlation  between 
critical  success  factors  and  quality  assurance. 

It  is  also  recommended  that  dietitians  critically 
evaluate  their  operations  using  critical  success  factors. 
In  this  regard,  dietitians  should  evaluate  their  immediate 
environments  to  determine  if  additional  critical  success 
factors  exist  locally.  Consideration  should  be  given  to  the 
amount  time  and  effort  spent  managing  (controlling)  critical 
versus  non-critical  success  areas.  Greater  attention  should 
be  given  to  the  critical  success  areas. 

Finally,  it  is  recommended  that  research  be 
conducted  applying  the  critical  success  factor  concept  to 
other  areas  within  the  Army  Medical  Department. 


ii 


m 


APPENDIX  A 


BASIC  DESIGNS  FOR 
MANAGEMENT  INFORMATION  SYSTEMS 
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LETTER  TO  PANFL  MEMBERS 


HSUB-AG 


DEPARTMENT  OF  THE  ARMY 

UNITED  STATE*  AHMY  MEDICAL  DEPARTMENT  ACTIVITY 
POUT  STEWART.  GEORGIA  31314 


5  January  1984 


VrankV  VfirstV  VlastV 

VaddressV 

VcityV 


Dear  VrankV  VlastV: 

Thank  you  for  ayreeing  to  participate  in  the  development  of  a  management 
information  system  for  use  in  our  nutrition  care  operations.  Your  insights 
will  be  most  helpful  in  evaluating  the  a^eas  this  system  should  cover. 

Specifically,  I  need  your  help  to  identify  major  areas  which  are  critical 
to  the  success  of  the  operation. 

The  results  will  be  used  to  develop  a  management  information  system  which 
will  aid  the  dietitian  to  better  control  ail  aspects  of  the  Nutrition  Care 
Division.  Addi cional ly ,  the  results  of  this  study  will  be  forwarded  to 
LTC  Roy  Maize  who  is  coordinating  the  development  of  a  quality  assurance 
program  for  our  operations. 

I  am  attaching  the  first  in  a  series  of  three  questionnaires  designed  to 
clarify  our  "critical  success  areas."  Please  complete  the  inclosed  question¬ 
naire  and  return  it  to  me  in  time  for  analysis  on  27  January.  If 
you  need  clarification,  please  call  me  at  AUTOVON:  870-6013/6001  or 
commercial:  (912)  757-6013/6001. 

Again,  thank  you  for  your  help. 


Sincerely , 


Incl 


James  L.  Rousey,  Jr,,  R.D. 
Major,  AMSC 

Administrative  Resident 
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QUESTIONNAIRE  //I 

Think  about  the  Chief,  Nutrition  Care  Division  managing  the  daily 
activities  of  the  division  (both  ?&S  and  CDB) .  What  general  aress  of 
concern  are  so  critical  to  the  success  of  the  division  that  the  chief 
needs  frequent  information?  Please  list  these  areas  in  the  appropriate 
column  below.  If  you  desire,  you  may  provide  comments  on  what  makes 
these  areas  so  important.  Please  be  succinct. 

Code  Date 


Area  of  Concern 


Commen  t  s 


Example:  Accuracy  of  Patient 

Trays 


Inaccurate  trays  may  be  detrimental 
t o_ t n epa t i en t . _ 


APPENDIX  D 


QUESTIONNAIRE  n 


Remember  1.  Choose  only  ten  areas  for  ranking. 
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INSTRUCTIONS  FOR  DELPHI 

QUESTIONNAIRE  ?3  ] 


Background:  Twenty-six  of  the  thirty-four  questionnaires  were  returned  in  time 
for  analysis.  The  analysis  resulted  in  an  overall  ranking  of  the  areas.  The 
ranking  was  accomplished  by  assigning  weights  to  each  vote.  For  example,  a 
weight  of  10  was  given  to  the  area  you  identified  as  #1;  a  weight  of  9  was 
given  to  the  area  you  identified  as  #2;  and  so  forth,  until  a  weight  of  1  was 
given  to  the  area  you  identified  as  #10.  The  weights  for  each  area  were 
consolidated  giving  a  total  raw  score.  The  overall  ranking  was  achieved  by 
placing  the  areas  in  order  according  to  their  total  raw  scores. 

Instructions: 

1.  Review  all  of  the  areas,  the  total  raw  scores,  the  ranking,  and  your 
intial  vote. 

2.  As  before,  select  the  top  ten  areas.  Tuis  o-es  you  the  opportunity  to 
alter  your  intial  vote. 

3.  As  before,  rank  the  top  ten  areas.  Give  a  vote  of  "1"  to  the  most 
important  area;  give  a  "2"  to  the  second  most  important  area,  and  so  forth, 
until  you  give  a  vote  of  "10"  to  the  least  important  of  the  ten. 

4.  This  should  be  the  last  questionnaire  you  receive.  If  votes  are  so  close 
in  some  areas,  there  may  be  a  need  for  a  fourth  questionnaire.  You  will 
receive  information  concerning  the  overall  results  of  this  delphi  process. 

5.  Finally,  please  conpiete  the  "Panel  Characteristics"  section  so  that  a 
profile  of  the  respondents  can  be  completed.  If  several  individuals  worked  in 
a  group,  the  leader  of  the  group  should  complete  this  section. 
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QUESTIONNAIRE  #3 

Critical  Success 

Total 

Prel iminary 

Your 

Your 

Areas 

Raw 

Ranking 

Initial 

Present 

Score 

Vote 

Vote 

Financial  Responsibility 

1.83 

1 

(Subsistence) 

Quality  and  Accuracy  of 

Patient  Tray  Service 

147 

2 

Quality  jf  Dining  Hall  Meals 

and  service 

105 

3 

Inventory/Subsistence  Management 

104 

4 

Documentation  of  Nutrition  Care 

99 

5 

Quality  of  Diet  Instruction 

85 

6 

Sanitation 

69 

7 

Personnel  Management 

65 

8 

i  Writing  of  Special  and  Modified  Diets  58 

9 

1  Appropriate  Provision  of  Nutritional 

Education 

49 

10  tie 

Army  Weight  Control  Program 

Responsibil ities 

49 

10  tie 

Fiscal  Responsibilities  (Nonfood) 

43 

12 

Food  Preparation 

41 

13 

Nutritional  Assessments 

39 

14 

Menu 

37 

15 

Equipment  Maintenance  and 

Replacement  Program 

34 

lo 

Availability  of  Personnel  32 

17 

J 

. 

. 

Headcount  Procedures 

28 

18 

Employee  Morale 

18 

19 

Personnel  Administration 

17 

20 

Operation  of  Diet  Clinic 

15 

21 

Securi ty 

14 

22 

tie 

Administrative  Requirements 

14 

22 

tie 

Inpatient  Interviews 

14 

22 

tie 

Inservice  Training 

11 

25 

Availibility  of  Subsistence 

9 

26 

Preparation  of  Tube  Feedings/ 

Enteric  Feedings 

8 

27 

tie 

Labor/Management  Relations 

8 

27 

tie 

Utilization  of  Leftovers 

8 

27 

tie 

Accuracy  of  Forecasts 

7 

30 

tie 

Standardization/Maintenance  of  Recipes 

;  7 

30 

tie 

Schedul  ing/Attenc'ance  of  Personnel 

7 

30 

tie 

Relationships  with  Outside  Activities 

4 

33 

Safety 

1 

34 

Ingredient  Room  Operation 

0 

35 

tie 

Cost  of  Nourishments 

0 

35 

tie 

Other  C.D.B  Functions 

0 

35 

tie 

Other  P  &  S  Functions 

0 

35 

tie 

APPENDIX  F 


PANEL  CHAP./  -  TER  I  ST  I CS  QUESTIONNAIRE 


PANEL  CHARACTERISTICS 


Please  indicate  your  response  to  the  following  areas: 

RANK  _ 

SEX  _ 

EDUCATION  LEVEL  (highest  degree)  _ 

YEARS  OF  MILITARY  EXPERIENCE  _____ 

YEARS  OF  DIETETIC  EXPERIENCE  _ 

EXPERIENCES: 

(check  all  experiences  which  you  have  had) 

Chief,  Nutrition  Care  Division  _ 

Chief,  Production  anj  Service  Br  _ 

Chief,  Clinical  Dietetic  Br  _ 

Staff  Clinical  Dietitian  _ 

Staff  Production  Dietitian  _ 

Other  ( _ )  _____ 


Would  you  describe  yourself  a:  an  Admini- ,rative  or  Clinical  Dietitian? 
(Underline  your  reply) 

What  is  your  current  position?  _ 


APPENDIX  G 


RANK  CORRELATION  AN-.tYS:S 


TABLE  15 


BANK-DIFFERENCE 

CORRELATION  C: 

IP  EAR  MAN  rho  > 

Qfi  RANKED  B'i 

AVERAGE 

WEIGHTED 

SCORE 

ARcn  of  concern  cs 

F  RANK  C 

A  RANK 

DIF  ‘(D) 

D'""2 

FISCAL  RE CRONS.  (SUB) 

1. 

16 

-15 

cr 

»  .J  ■  J 

FISCAL  RESPONS.  (NON) 

12 

18 

— G* 

3G 

INVEHTORY/SUBS  MG NT 

cr 

11 

-6 

3G 

DIET  INSTRUCTIONS 

•“t 

cr 

■-<  cr 
tC.  •  J 

ARMY  NT  CONTROL 

11 

15 

-4 

16 

ODER  OF  DIET  CLINIC 

SG 

17 

Q 

81 

MUTF: I T I OHAL  ASSESSMENTS 

15.5 

© 

7 . 5 

56 . 25 

WRITE  DIETS 

10 

G 

4 

16 

INPATIENT  INTERVIEWS 

OCT 

S'  .  j 

12 

529 

DOCUMENT.  OF  HUTR  CARE 

4 

id 

il. 

4 

SANITATION 

7 

4 

© 

y 

EQUIP  MAI NT 

i  cr  tr 

1  •  J .  J 

•■?  O 

-16. 5 

272.25 

Q  UAL /f  ICC  OF  AT  TRAYS 

1 

1 

1 

QUAL  OF  DN  RM  MEALS 

o 

5 

ii~. 

4 

NUTRITION  EDUCATION 

Q 

y 

0 

0 

FOOD  PREP 

13 

13. 

5 

-.'5 

.25 

ACC  OF  FORECASTS 

21 

yy  „ 

5 

-1.5 

.-i  ©  cr 

it-  ft  tL..  'J 

RECIPES 

26 

24 

4 

LEFTOVERS 

30 

«-« © 

£ —  m 

5 

7.5 

err:  ©cr 
•JO  b  «L. ■  J 

INC  RM  OP 

35 

35 

0 

0 

MENU 

14 

10 

4 

is 

OTHER  P/S 

35 

36. 

5 

-1.5 

•-I  ©  cr 

OTHER  COB 

35 

36. 

5 

-1.5 

©  © cr 

4—  ■  tl-  •  J 

ADMIN  REQ 

*~*o 

31 

v.i 

9 

LABOR/MGMT 

26 

©  o 

>7,1 

-12 

144 

HEADCOUNT 

19.5 

21 

-1.5 

2  „  25 

AVAIL  OF  SUBS 

23.5 

33. 

5 

-10 

100 

AVAIL  OF  F'ERS 

19.5 

27 

—  *7  CM 
f  -  ■  J 

56.25 

I.  NS  VC  TRHG 

oo 

13. 

5 

8.5 

72.25 

SAFETY 

30 

20 

10 

100 

EMF  MORALE 

18 

25. 

5 

-7,5 

56.  25 

PEES  ADMIN 

23.5 

‘“i  © 

u-W 

-4.5 

20.25 

FEES  MGMT 

G 

29 

-23 

529 

SCH/ATT  PERSONNEL 

35 

30 

5 

25 

TUBE  FEEDINGS 

35 

r" 

OO 

il-L.' 

784 

COST/NOURISH 

35 

25. 

5 

9.5 

98.25 

SECURITY 

17 

1 9 

4 

DEPT  RELATIONSHIPS 

30 

cr 

cr 

— o  -  J 

12.25 

Total. 

0 

3398 . 5 

rho  =  .6281321 81 


TABLE  16 


R A N K -DIFFERENCE  CORRELATION  < SPEARMAN  rho > 
QA  RANKED  BY  PERCENTAGE  OF  HIGH  RESPONSES 


AREA  OF  CONCERN  C 

SF  RANK  Of 

'1  RANK 

DJ.F  <  D ) 

D---2 
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1 

12 

-1.1 
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12 

19 
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49 
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r 
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4 

4 
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11 

Q 
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26 

17 

Cl 
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10 
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-9 
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4 
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30 
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14 

13 
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35 
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u. 

4 
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37 

in 
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oo 
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26 

£ 
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26 

35 
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o 
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24 
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11 

24 
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21 

-4 
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